An approach to visual interaction in mixed-initiative planning

Researchers in mixed-initiative problem-solving have generally viewed interaction between the user and the system as a form of dialog, which provides an e ective unifying framework for multimodal systems. For mixed-initiative interaction through a visual medium, however, an approach that exploits our visual perceptual abilities and the bene ts of direct manipulation mechanisms is equally compelling. This paper explores the possibility of communication between human planners and intelligent planning systems via shared control of a three-dimensional graphical user interface. We are currently testing our early development e orts in the Visual Interaction Dialog (vid) system, which supports agent and user manipulation of camera placement for communicating plan structure and domain informa-